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ABSTRACT 


We  consider  a  heteroscedastic  linear  regression  model  with  normally 
distributed  errors  in  which  the  variances  depend  on  an  exogenous  variable. 
Suppose  that  the  variance  function  can  be  parameterized  as  with  0 
unknown.  If  0  is  any  root-N  consistent  estimate  of  0  based  on  squared  residuals, 
it  is  well  known  that  the  resulting  generalized  (weighted)  least  squares  estimate 
with  estimated  weights  has  the  same  limit  distribution  as  if  0  were  known.  The 


covariance  of  this  estimate  can  be  expanded  to  terms  of  order  N 


If  the 


variance  function  is  unknown  but  smooth,  the  problem  is  adaptable,  i.e.,  one  can 
estimate  the  variance  function  nonparametrically  in  such  a  way  that  the  resulting 
generalized  least  squares  estimate  has  the  same  first  order  normal  limit 
distribution  as  if  fhe  variance  function  were  completely  specified.  Jri  a  special 
case  wd  computed ah  expansion  for  the  covariance  in  this  semiparametric  context, 
and  findthat,  the  rate  of  convergence  is  slower  for  this  estimate  than  for  its 


parametric  counterpart.  More  importantly. 


,  there  is  an  effect  due  to 


how  well  one  estimates  the  parlance  function.  We— usg  a  kernel  regression 
estimator*_and— find— tha^  the  optimal  bandwidth  in  ouf  problem  is  of  the  usual 
order,  but  tha£  the  constant  depends  on  the  variance  function  as  well  as  the 


particular  linear  combination  being  estimated. 


SECTION  1  :  Introduction 

We  consider  a  heteroscedastic  linear  regression  model  with  normally 
distributed  errors  and  replication  : 

-  xi^ +  Vu  •  ('  - 1 . N :  ■*  -  *-2>  : 

(1.1)  Oj2  =  +(z1.e)  ; 

=  0  ;  Variance  (17^)  =  2. 

In  this  model,  the  regression  parameter  is  p,  and  the  variance  function  is 
The  {Zj}  are  scalars,  possibly  a  component  of  the  p-dimensional  vectors  (x^). 
Throughout,  we  will  assume  that  the  (x^ , z^}  are  independent  and  identically 
distributed  random  variables  mutually  independent  of  the  j )  -  The  errors  {q.^} 
are  assumed  to  be  independent  normally  distributed  random  variables.  The  reason 
that  the  variance  of  tj^  equals  2  will  become  clear  later. 

A  A 

Let  0  be  the  mle  of  0.  The  mle  P^  of  P  is  a  generalized  least  squares 
estimate,  i.e.,  weighted  least  squares  with  the  estimated  weights  1/>/<(z ^0).  Let 
-1  N  t 

(1.2)  SL.  =  N  2  x.  x  /  ^(z.,0)  - »S  (positive  definite), 

n  i=1  it  l 

A 

then  it  is  well  known  that  P is  asymptotically  normally  distributed  with  mean  P 
and  covariance  S  */N,  i.e.,  with  "O”  denoting  convergence  in  distribution. 

(1.3)  N1/2(£w  -  P)  O  Normal (0,S_1). 

The  limit  distribution  (1.3)  is  the  same  as  if  0  were  known,  so  that  (1.3) 
expresses  a  parametric  adaptation  result. 

A 

A  simplification  of  an  argument  of  Rothenberg  (1984)  shows  that  P  is 

w 


symmetrically  distributed  about  P  with  a  covariance  expansion 

(1.4)  Covariance  ^  ~  P)  |  =  S1+N1Aw  +  o(N  1), 

where  A^  is  a  positive  definite  matrix.  Such  second  order  covariance  expansions 
when  the  variances  depend  on  the  mean  and/or  the  errors  are  not  normally 
distributed  have  been  investigated  by  Carroll,  Wu  &  Ruppert  (1987). 

Suppose  that  instead  of  a  parametric  model,  the  form  of  the  variance 
function  is  not  known  a  priori,  so  that  we  can  write 

o 

(1.5)  CTj  =  'Kzi)  =  1  /  g(zi).  'P  unknown. 

Now  the  unknown  parameters  are  (/3,>/>),  so  we  are  in  a  semi  parametric  context,  see 
Bickel  (1982)  and  Begun,  et  al .  (1983).  It  is  easy  to  show  that  the 

semiparametric  information  bound  here  is  the  same  as  if  $  were  known.  Carroll 
(1982),  Robinson  (1986)  and  Carroll,  Ruppert  &  Stefanski  (1987)  have  constructed 
adaptive  estimates  as  follows.  By  smoothing  techniques  such  as  kernel  or  nearest 

A 

neighbor  regression,  they  form  an  estimate  'P  of  'p,  and  then  construct  the 

A  A 

generalized  least  squares  estimate  Pg  of  P  with  the  estimated  weights  l/\p(z j). 
These  estimates  have  the  same  limit  distribution  as  if  \p  were  known,  i.e., 

N1/2(0g  -  P)  ^  Normal (0, S_1)  . 

A  A 

If  is  chosen  appropriately,  P  is  symmetrically  distributed  about  p.  In  this 

A* 

paper,  we  pick  a  particular  estimate  \fi  based  on  kernel  regression  techniques  and 
compute  an  analogue  to  the  covariance  expansion  (1.4),  namely 

Covariance  N1/2(Pg  -  P)  ]  =  S_1  +  N_4/5Ag  +  o(N_1). 


i'fl.T  (0.*  *.»  * i” -T l* **«  I 


MM 
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There  are  two  major  conclusions.  The  first  is  that  the  second  order  covariance 
expansion  converges  at  a  slower  rate  for  the  semiparametric  model  (l.L)  than  it 
does  for  the  parametric  model  (1.1).  Of  more  general  interest  is  that  the 
optimal  bandwidth  for  estimating  any  linear  combination  of  the  regression 
parameter  (3  is  still  of  the  usual  order,  but  it  depends  not  only  on  the  variance 
function  but  also  on  the  particular  linear  combination  being  estimated. 

In  a  sense  the  context  we  are  working  in  is  narrow,  but  there  are  some 
general  implications  to  our  results.  In  the  semiparametric  context,  there  is 
some  concern  that  much  larger  sample  sizes  than  usual  will  be  needed  to  achieve 
approximate  normality  than  is  true  in  a  parametric  model.  Hsieh  &  Manski  (1987) 
state  "It  is  sometimes  asserted  that  satisfactory  nonparametric  estimation  of 
score  functions  requires  very  large  samples;  hence,  adaptive  estimates  should 
perform  poorly  in  moderate  size  samples”. 

Our  results  indicate  that  semiparametric  adaptive  estimates  should  indeed 
converge  more  slowly  than  do  parametric  estimates,  which  is  not  too  surprising  a 
result  but  is  at  least  worth  nailing  down.  With  considerable  fine  tuning  of 
their  estimate  of  the  nonparametric  part  of  their  model,  Hsieh  &  Manski  are  able 
to  do  fairly  well  in  their  two-sample  problem.  It  is  clear  from  their 
simulations  that  how  well  one  estimates  the  nonparametric  part  of  their 
semiparametric  model  can  affect  the  small  sample  properties  of  the  parametric 
estimator.  Our  results  are  a  theoretical  complement  to  their  simulations.  How 
well  one  estimates  the  semiparametric  nuisance  function  'p  can  affect  the  small 
sample  performance  of  the  parametric  estimates. 
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SECTION  2  :  A  Second  Order  Covariance  Expansion 


l 


The  key  to  our  construction  is  that  replication  in  a  normally  distributed 
context  allows  us  to  do  weighted  least  squares  with  estimated  weights  which  are 
distributed  independently  of  the  "data".  Let 

1  /9 

£i  =  (nn  +  Vi2)/2  :  6i  =  £i  * (zi)  : 

1  /9 

fei*  =  (yil  "  yi2)/2  *  *  (zi>  ^il  ‘  T>i2)/2  • 

Note  that  the  sequence  {e^}  is  observable.  Because  the  {17^}  are  normally 


i  j 


distributed,  the  sequences  {6^}  and  {e^}  are  mutually  independent  and 
identically  distributed  standard  normal  random  variables.  Also,  the  {e^}  are 


distributed  independently  of  the  {aiw}-  Since 


E{  et/  }  =  *(**)  . 


it  is  plausible  to  base  estimates  of  the  weights  on  the  {&iK  }•  Of  course,  this 
will  not  be  the  most  efficient  way  to  estimate  the  variance  function  but  will 
still  allow  us  to  estimate  P  efficiently  to  first  order.  We  first  write  the 

A 

results  in  terms  of  g(z)  =  l/>J<(z),  see  (1.5).  Let  g^  be  an  estimate  of  g  which 

2 

is  based  solely  on  the  Make  the  following  definitions  : 


vN(z)  =  gN(z)  -  g(z)  ; 


5N 


N 


%  -  g(zi>  ; 


N 


®N  =  N"  ** iV  gN<zi>  : 


.,-1/2 


N 


-1/2 


N 


^  =  N  tflWV  RN  =  N  %{zi)  : 


”n  ■  ®N  “  SN  :  QN  =  RN  RN 


i.|  >«#  MAt 


LEMMA  1  :  For  any  N. 


°ov[  N1/2(5g  -  «  ]  =  s1  *  e[  t„  V  ] 


PROOF  OF  LEMMA  1  :  Note  that 


Tn  =  N1/2(Pg  -  ?w)  :  E{Tn}  =  0  . 


the  latter  following  easily  since  is  independent  of  the  (fij).  Since  the 

A 

distribution  of  does  not  depend  on  P  and  P^  is  a  complete  sufficient  statistic 

*  ^ 

for  p,  by  Basu's  Lemma  is  independent  of  P^.  This  means  that 

Cov  [  N1/2(Pg  -  P)  ]  =  Cov  [  N1/2(Pw  -  P)  ]  +  Cov[  Tn  ] 


*  V1  +  E[  T»  V  ] 


Because  is  positive  (semi)  definite,  Lemma  1  implies  that  estimating 

weights  by  our  method  results  in  an  inflation  in  variance.  Define 


S  -  tn  V  -  <qn  -  W  (On  -  W‘ 


We  show  in  the  appendix  that  under  reasonable  regularity  conditions,  C^=Op(N  )■ 
Thus,  it  is  not  too  implausible  to  assume  that 


(2.1) 


NeJcj,]  - ►  0  as  N 


THEOREM  1  :  Assume  (2.1).  Then 


(2.2)  cov  [  r'*(pg  -  P) 


vwwww 


■fi 

» 


s 


.■#vt 


& 

8 

& 

si 


».*-W 


m 


5* 

$ 


-  S  +  S  1  E<  QN  QN  >  -  E<  MN  SN  V  >  jSN  +  °<N  )■ 


The  proof  is  in  the  appendix. 


The  translation  from  g^(z)  -  g(z)  in  the  definition  of  and  is  to  note  that 


(2.3) 


gN(z)  -  g(z)  =  -[  *N(z)  -  '/'(z)  ]  /  *2( z) 


We  will  ignore  the  error  in  (2.3)  by  subsuming  it  under  "additional  regularity 


conditions".  Define 


Vi  =  Xi  Xi  : 


_i  ^  r  -  4 

^  =  N  J2!  V1  l  J  7  * ^  : 

®N  =  N_1i2i  xi  ^  [  V^)  -  *(z)  ]  /  .2(z)  . 


The  direct  translation  from  (2.2)  is 


(2.4)  Cov  N  (P^  -  P) 


-  v‘  *v1e(*ni  -  e<  h,  y1  y  >  ]y 1 


In  the  next  section  we  compute  (2.4)  in  a  special  case. 


+  o(N  V 


PiV 

MS* 

p,v 

k; 


>V»*i 


SECTION  3  : 


The  purpose  of  this  section  is  to  get  an  explicit  expression  for  the 
covariance  expansion  (2.4)  in  a  special  case.  The  major  question  is  whether  the 
second  term  on  the  right  hand  side  is  of  order  0(N  ^ )  as  it  would  be  in  the 
parametric  case.  We  use  a  kernel  regression  estimator.  Let  K(*)  be  a  symmetric 
density  with  bounded  support  and  let  f(*)  be  the  marginal  density  of  the  {z..}. 


Let  b  = 


bN-° 


be  the  bandwidth  and  define 


K^u)  =  b_1  K(u/b) 
[K]  =  |  u2  K(u)  du 


The  estimator  we  will  use  is  a  leave-one-out  type  estimator,  which  Robinson 
(1986)  has  also  found  to  be  convenient  analytically: 


We  will  also  need  the  following  : 


O  7  2  Mzi  "  zi) 


(3.1)  N  b^u  - >  0  . 

(3.2)  J  v  K^(v)  dv  =  0  . 

(3.3)  If  ^  is  the  jth  derivative  of  ^  and  f^  is  the  first  derivative  of  f,  then 

cj(v)  =  (1/2)  d(v)  [K],  where 
d(v)  =  *2(v)  +  2f1(vH1(v)/f(v). 

Define  the  following  terms  : 


(3.2) 


mmm  im  msm  m  gna  b mpto  fzmsxm  wlwwa’  mw^wA^wwwnM^ 

N3 

v. 
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c2(y)  =  ^4(v)  /  f(v) 


d1  =  ^  1  E  [xx^z)*  3(z)]sn  1  ;d2  =  Sn  1  E  xx^^z)*  3(z) 


-1 


r  =  1  E  xxtc1(z)^  2(z)  Sj^  1  ; 


S  =  E 


xxV^(z)  j 


(see  (1.2)) 


d^  =  d2  _  t  Tt  £  0  (by  Cauchy  Schwarz). 


THEOREM  2  :  Assume  (2.4).  Then,  for  estimating  any  linear  combination  a  /3. 
(3.4)  Cov  [  N1/2(at 

=  a1  [s-1 


Pg  -  *P) 


+  (NbN)  \  +  bN4  d3  a  +  o(b4  +  (NbN)  1). 


-1/5 

From  (3.4),  the  optimal  bandwidth  is  cN  .  where 


(3.5) 


=  [,  a'd,.  ]  /  [  4  a'  d3  a  ] 


1/5 


Note  how  the  optimal  bandwidth  depends  on  the  design  and  which  linear  combination 
you  are  interested  in  estimating. 

Remark  •'  Assume  the  result  of  Lemma  1,  we  could  generalize  (3.4)  and  (3.5) 
somewhat  by  allowing  the  z^  to  be  q-vectors.  The  changes  needed  are  these: 

lyu)  =  b_qK(u/b);  [K]  =  J  uutK(u)du  ; 

Cj(v)  =  (1/2)  trace(d(v)  [K]),  where 
d(y)  =  ^2(v)  +  ('Pl(v){  i(v)1  +  f1(v)'/'1(v)t)/f(v). 

The  optimal  bandwidth  is  cN  and  (3.4)  and  (3.5)  become 


(3.4) 


Cov 


N1/2(a 


%  - aV)  ] 
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=  a*  [s'1  +  (NbNq)  \  +  bN4  d3]  a  +  o(b4  +  (Nb^)'1). 


(3-5) 


=  q  a^ja  ] 


t.  I17^ 


/  I  4  a  d3  a 


t  j  ■,  l/(4+q) 
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Without  loss  of  generality,  we  may  set  =  I. 


LEMMA  A.l  :  Assume  that 


(A.l) 


II  M^  II3  =  o  (N  l) 


(A.2) 


II  Qn  II  -E->  0. 


(A. 3) 


"w  «n  qn  "  =  °p(N' > 


Then, 


TN  V  =  <«N  -  W  -  W‘  *  “pC'1) 


PROOF  OF  LEMMA  A .  1  :  We  have  that 


V1  -  V1  -  -*N  +  “n  "n  +  °p<  11  “n  "3  )  • 


Thus, 


tn  =  ®n  **n-sn1rn  =  ^n1~sn  !)^n  +  ^  “  V 


■1  «  -1 


-  <V  -  Sn"‘)RN  +  <V'  -  VH  *  V‘  «N 


*  [  -"n  +  %  "n  ]  *N  +  [  -*1,  +  «N  "n  ]  «N  +  V1  «N 


*  Opt"'1) 


-  V  QH-MNRNt%MNRN-MN0N*  °p<»  >  • 


the  last  following  from  (A.l)  -  (A. 3).  From  (A.l)  -  (A. 3),  we  have 


tn  v  -  v1  s  v  v1  -  «n  rn  v  v1 


-  [  S  *N  V  V'  ]*+  "k  *n  V 


*K  +  %("■’) 


Since  =  I,  the  proof  is  complete. 


1  *4*  t**  «Ak 
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LEMMA  A. 2  :  Define 


=  *i  xit  /  g^)  =  x±  x ^  HzJ. 


Then, 


E[  qn  V  ]  - £  E[ *,  -  s(^)>2  ] 


PROOF  OF  LEMMA  A.2  :  Since 


Q»  Q"'  =  "’’ifl  jl  5i5‘  X‘Xj'  {^'Zi>  ‘  E(I1)}  <%<*.)>  '  gtZi))  ’ 


N  N 


and  since  and  the  {§i}  are  independent,  we  find  that 


E[  qn  qu  |  %•  <xrzi>  ]  =  "  ^  {gN(Zi)  -  g(Zi)}2  . 


This  completes  the  proof. 


LEMMA  A. 3  :  We  have  that 


E[  <%  -  "n  V  <«n -*h¥']=e[  «n  V  ]  -  E[  “n  V 


PROOF  OF  LEMMA  A. 3  :  Exploiting  the  independence  of  g^  and  the  {dL},  as  well  as 
remembering  that  =  I,  we  see  that 


E[  «N  *N  V  "»'  ]  =  E[  ^  ]  ■ 


It  thus  suffices  to  show  that 


E  .  MN  *N  QN  I  gN’  ^xi,zi^  =  Mn  MNt  • 


m 

M 

w 

m 

iMi!< 


I 

•vft* 

•ft'.1 


m 

k 


K»#‘ 

•lY.* 
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a  t ' »  > Jl  - 1  i 


**  t’l 


,  *(1 .  .  I'j  >»,  <*, 
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This  is  routine.  □ 

PROOF  OF  THEOREM  1  :  The  proof  follows  from  the  previous  Lemmas.  □ 

APPENDIX  B 

Our  calculations  rely  on  the  following  result  due  to  Collomb  (1977,  1981). 

PROPOSITION  B  :  Let  K  be  a  symmetric  q-dimensional  density.  Let  (X.Y)  €  IR0***. 
where  X  is  a  q-vector.  Define  m(x)  =  E[y  |  X=x  ]  and  let  f(x)  be  the  marginal 
density  of  X.  Assume  that  m(x)  and  f(x)  are  four  times  continuously 
differentiable.  Define 

K^u)  =  b~^K(u/b) 

^(u)  =  2Yt  ^(x-Xp  /  J^x-X,) 

v(x)  =  E[  {Y  -  m(x)}2  I  X=x] 

[K]  =  |  u  u*  K(u)  du 

b(x)  =  (l/2)m2(x)  +  ( 1/2)  [mj  (x) f  j  * (x)  +  f  ^xjm^xjyf  (x) . 

Then,  as  b  — »  0, 

En^fx)  -  m(x)  =  b2  trace(b(x)  [K])  +  0(b4)  ; 

Var{m^(x)}  =  (Nb*1)  *  v(x)  J  K^u)  du  /  f(x)  +  0(N  *b  q+2).  □ 

T.FMMA  H-1  :  Under  regularity  conditions  (Proposition  B)  on  and  K, 

(B.l)  s(Zj)  =  e[  ijjtZj)  |  Zj  ] 

-  +<y> +  Vs  *  Vb»4)  ■ 

PROOF  OF  I FMMA  B . 1  :  Immediate  from  Proposition  B.  □ 


1 


LEMMA  B.2  :  If  s(Zj)  is  defined  in  (B.l),  we  have 


E  C  iN(zi)  ~  s(zi)  ]2  zt  ] 


=  c2(zi)/{Nbnq>  +  0_(N  \2~q)  . 


PROOF  OF  LEMMA  B.2  :  From  Proposition  B  with  Yi  =  =  z..  m(x)  =  *(x) .  n 


LEMMA  B.3  :  We  have 


E[  |  *1  ] 

-  -  bn4  cl2^zi)  +  °p(bN6  +  N"\(2'q)). 


PROOF  OF  LEMMA  B.3  :  The  expansion  in  question  is 


E[  CV^j)  -  s(Zi)]2  |  Zj  ]  +  [5(Zj)  -  *(zt] 


*  C2<2l>/<%>  *  C  cl2(zi>  *  V'S*"1)  *  0  (bj,6) 


Now  assume  without  loss  that  S„  =  I.  Define 

N 


Wi  =  Xj  x^  /  ^(Zj)  ;  Dj  =  v//(z.)  W. 


LEMMA  B.4  :  As  N  — *  00 , 


(B.2) 


E[  N_1  j,  *i  CV2i>  -  «2i>]2  ] 


=  dj/tNb^}  +  bN4  d2  +  0(bN6  +  N~1bN{2"<1>)  . 
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PROOF  OF  LEMMA  B.4  :  Apply  Lemma  B.3  after  conditioning  on  (x^z^).  D 

Lemma  B.4  gives  us  the  form  of  E{A^}  in  (2.4),  and  in  order  to  complete  the 
calculation  we  note  that  =  B^  +  B^.  where 


Uni  =  N  ^  Di  £Vzi>  - 


BN2  =  N”1  2^  D4  C^Cz±)  -  s(zi)] 


It  is  easy  to  see  by  conditioning  that 


E(Bm  bh2>  -  0 


LEMMA  B.5  :  As  N  — > 


E<  ®N2  O  *  V  T  T*  ♦  “(N_lbnq  +  O 


PROOF  OF  LEMMA  B.5  :  Let  =  E{  B^2  }.  Now. 


<=»  -  »N2  T  *  °(b/) 


By  (3.1)  and  (B.l). 


®N2  ®N2  ^  =  E[  tBN2  Cw^  ^2  C*^  ]  +  c*  C«t 

=  cM  c +  o(N  1)  =  bN4  r  tX  +  otN-1!^  +  bn4). 


J.s.  •k-’it*  <»• 


.'I  >  >k  *■*  i*|  |  s.i 


It  is  the  calculation  of  the  second  moment  matrix  for  B...  that  causes  the  most 

N1 


difficulties.  Write  Dfz^)  =  D.. 


LEMMA  B.6  :  As  N  — > 


E{  ^1  BNlt>  =  N_1  E[  ^z)  D(z)  D(z)t  ] 

-  N-1  e[  D(z)  Hz)  ]  e[  D(z)  Hz)  ]*  +  o(N_1)  = 


0(N-1) 


PROOF  OF  LEMMA  B.6  :  B^j  is  the  average  of  mean  zero  but  not  independent  random 


variables.  By  Lemma  B.2,  we  have 


t  -2 N  N  r  l  -i 

bm  ’W  >  -  B  l  *  E[  D1  DJ  h  fj  J  +  *>. 


By  a  direct  calculation, 
(B.3) 


where  =  ^(z^  -  sfZj)  . 


E{  fj  f j  I  zj*  sj  >  “ 


CN-1)  ^  J  e[  [^(i.k)  -  s(z.)]  -  s(Zj)]  |  Zj.zJ. 


where  ^(i.k)  =  e^2  ^(z^z.)/^}  /  {bN  fz(z.)}  ; 

s(zt)  =  e[  x^(i ,k)  |  z.  j  . 

If  (i.j.k.m)  are  all  distinct,  the  expectation  is  zero.  There  is  only  one  case 

_o 

that  (k=j)  *  (i=m),  and  its  contribution  is  of  order  N  .  which  is  too  small  to 
matter.  There  are  (N— 2)  terms  in  which  k=m^i,  k=m^j,  i^j.  Thus,  (B.3)  is 

N_1J  [  ^(V)  K<^v~zi)/bN}  KUv-zj)/bN}  fz(v)  ] 

X  [  bN2  fZ(zi}  fZ(zj}  ]  1  dv  "  N_1  +  OpfN"1) 
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E:;l 
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=  |C*  [  -  +(z,)+(Jj)  ] 


*  OpOf1). 


We  thus  see  that 


£{  %  BN1t}  =  N"1  E[  D(Zi)  D(Zj)  {  ^(zi>Zj)  -  *0^)  ^(Zj)  ]  +  o(N_1) 


To  complete  the  proof  we  have  to  show  that 


(B.4) 


e[  D(zi)  D(Zj)  HN(Zi.2j)  ]  =0(1) 


Taking  into  account  the  form  of  H^,  we  find  that  (B.4)  equals 

J  J  J  V2  D<zi>  D(zj>  Mv)  K^v'zi)>  K{(v-Zj)}fz(v)  dv  dz..  dZj 

=  J  J  Jn4(v)  K(wt)  K(wj)  D(v  +  ^wi)  D(v  +  ^(wj)  fz(v)  dwi  dwj  dv 
=  J  ^4(v)  D(v>  D(v)  fZ(v)  dv  +  0(bN2)  , 


completing  the  proof. 
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